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(54) IMPROVEMENTS IN OR RELATING TO 
DETECTION APPARATUS 

(71) We, HITAQII LIMITED of 1-5-1 Marunouchi, Chiyoda-ku, 
lolqro, Japan, a body corporate organized according to the laws of Japan, do hereby 
declare the invention, for which we pray that a patent may be granted to us. and 
the method by which it is to be performed, to be particulariy described in and by 
5 the following statement: — ■ ' 

The present invention relates to apparatus for detecting small portions of a 
larger pattern. A particular apphcation of the invention is for the detection and 
exiraaion of defects or bad spax% from a pattern, and much of the foUowing descrip- 
tira deals with this, but it is to be understood that the invention is not so limited 
and refeiences hereinafter to defects or bad spots should be read to include small 
pattern portions m general, where the context permits. 

Previously, parts having complex patterns such as printed circuits or IC pellets 
have ban exammed visually by the inspectors, but since defective areas are generally 
included in die complex patterns of these devices and are very small in size, they 
may pass mdetecttd very often, and a lengthy inspection is required, even by a skilled 
inspector. Furthermore eye fatigue is considerably mcreased when visual inspection 
is cononued for a long time. In order to improve productivity and to save the labou^ 
cos^ there has been devised and demonstrated an automated inspection equipment 
cajable of detecting the defects included in a simple pattern in a plain backffound 
such as paper, glas^ steel or the like, but so far no automated inspection equ^ment 
especiaUy adapted for deteaing bad spots or micro-defects included in a complex 
pattern such as a printed circuit or IC pellets has been proposed yet. 

There has been proposed an inspection method in which a reference image which 

i^fZ f f y ^^^^^ '^^ Of ^e'^ents in two states such 

as bri^t and dark areas is opucally registered with an image of a part to be inspec- 
ted which mdudes bad spots or defects so that the latter may be indicated The 
reference image must be registered with the image of a part to be inspected with a 
nl,!;.ft^- ^^^^'^y- i'or ^his purpose, a reference or standard object and a 

l^l »;5f r".? T '^""^^ ^''^^ '° P°^°°' ^"'i '^^^ object « illumin- 
ated with red light whereas the part to be mspected is iUuminated with green light 

so that an inspector may see the unages through a semi-transparent minor Whoi 

SackThelr^tlLvt"''^^ '1^' ^^P^^'i' dark"rTbecTmS 

b ack whereas the bngbt area becomes white by combination of the red and green 
Uummation. However a bright bad spot included in the dark area of the s JdS 
shows green wher^s a dark bad spot included in the bright area of the standard 

SLnt? '\^J^^^ °^ ^"^^^ ^ this method STac 

disadvantage tiiat the registration of the image of the reference object with the Lge 

t fhft 1- be ."ispected must be made widi an extremely high degree of accuracy" 
so that this method may be carried out only by a skiUed inspector. When diereh a 
misalignment between the two images, the mis^igned portioS be«.meTreS or ^ 
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so that they arc mistakenly taken to be defects. Therefore this method is not entirely 
suitable for automated inspection equipment 

According to the present invention there is provided apparatus for detecting and 
extracting portions in a pattern including; input means for sequentially scanning a 

5 pattern to be inspected and converting said pattern into an electrical video signal; 5 

means for sampling said video signal at predetermined sampling time intervals cor- 
responding to picture elements of said pattern to be inspected and converting said video 
signal into binary form; a two-dimension image extracting means for rearranging the 
one-dimensionally arranged output from said sampling and binary converting means into 

10 a two-dimensionally arranged signal representing a sub area of the pattern; and small 10 
portion processing means for extracting a signal from the information stored in said 
two-dimensional image esctracting means^ thereby extracting a small pordon from 
said pattern. 

The invention will be more particularly described by way of example with 
15 reference to the accompanying drawings, wherein: — 15 
Figure 1 is a block diagram of an apparatus in accordance with the present 
invention; 

Figures 2, 3 and 4 show the daik and bright patterns to be inspected by the 
apparatus of Figure 1; 

20 Figure 5 is a block diagram of an apparatus incorporating a floating threshold 20 

type analogue-to-digital converter; 

Figure 6 shows one example of the image of a pattern to be inspected; ^ 
Figure 7 is a block diagram of an apparatus similar to that shown in Figure 1 
but including a two-dimensional image extracting device; 
25 Figure 8 is a block diagram of an apparatus similar to that shown in Figure 7 25 

but with a modification of the two-dimensional image extracting device; 

Figure 9 is a block diagram of an apparatus similar to that shown in Figure 7 
but with another modification of the two-dimensional image extracting device; 

Figure 10 is a detailed view of a component of the apparatus shown in Figure 9; 
30 Figure 11 is a view used for explanation of the apparatus shown in Figure 9; 30 

Figures 12 to 15 are views used for explanation of the use of the boundary 
spacing method in the present invention; 

Figure 16 is a detailed block diagram of the apparatus of Figure 1; 
Figure 17 is a diagram of a micro-spot extracting circuit based upon the bound- 
35 ary spacing method; 35 
Figure 18 shows the logic patterns used for the explanation of the boundary 
spacing method; 

Figure 19 is a diagram of the boundary extracting circuit shown in Figure 16; 
Figure 20 shows Ae logic patterns used for the boundary extraction method; 
40 Figure 21 illustrates one example of a comparator used in the apparatus shown 40 

in Figure 16; 

Figure 22 to 27 are views used for the explanation of the use of the enlargement- 
reducuon method; 

Figure 28 is a block diagram of an apparatus similar to that shown in Figure 
45 1 except that a small portion processing device based upon the enlargement-reduction 45 
mediod is incorporated therein; 

Figure 29 is a diagram of a small portion extracting circuit based upon the 
enlargement-reduction method; 

Figure 30 is a perspective view of an optical processing device based upon the 
50 enlargement-reduction method to assist in the understanding of the invention; 50 
Figures 31 to 35 are views used for the explanation of the use of the boundary 
averaging method in the present invention ; 

Figure 36 is a view used for the explanation of the bad spot extracting method; 
Figure 37 is a block diagram of an apparatus similar to that shown in Figure 1 
55 except that a micro-spot processing device employing the bad spot extracting metiiod is 55 
incorporated therein; 

Figure 38 shows the logic patterns used for the explanation of the bad spot 
extracting method; and 

Figure 39 is a diagram of a micro-spot extracting device based upon the bad 
60 spot extracting method, ^ 
First there will be some explanation of some tmderlying principles of the 
present invention. The inspection equipment to be described is intended to inspect a 
multi-dimensional pattern consisting of two conditions^ ON and OFF or light and 
dark, which are referred to as "binary states" in this specification. Therefore, the 
65 'patterns may be a one-dimensional pattern such as telegraph codes, a two-dimensional ^5 
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For the foBowing description of embodiment exemplifying the present invention 

not limited Aereto and can Tise any one- or multi-dimensional pattern 5 
, A two-dunensional binary pattern is for example a black character or the like 

a pattern havmg a binary charaaer in the strictest sense of the word. FoTcxbS 
binary informauon may be derived from a multi-colour poster by ushg a^ S 

J^Sle b^CiS^""^ '""^y ^'^^ '^"^ fflLnated'K 
In case of a two-dimensional multi-level pattern in which the tone is varied in 

mto a two-dunensional pattern by a suitable threshold proc«sing tSo± '^"'^ .5 
Now, referrmg to Figure 1 illustrating a simple aiangemclt^aSTdance with 

"i"? « necessarTan optical filtw (not sS 

12 IS sampled by a samphng circuit 13 which may bTof the type diviS Se 20 
nmg signals of die TV camera by a predetermin^ time intemh S^tout sS 
of Je samphng circuit 13 which varies in level depending Zn t£ (SSeSS 

S^^hlfL^H-""'' °i P"'' ^1 ^ quantizing ciredt (ot AD cSSS) M 
(In tius embodiment, die output signal of the video input device 12 is St^nS 
and ±en converted mto binary signals, but it wiU be LeS tiiat thT^id^S 
put signal may be first converted into the binary signals and tiien amoledr The 
quantizing circuit 14 may be an analogue com^rat^ or TaD coren? w£e 
30 1 :^Ta^. 'finals may be converted into the binary sSndT by siSwl 

^'^'i discrinunatmg means. The present invention 7n 4 a Led tSSd 
m^od or a floatmg threshold method as wUl be described in detail h^Sato Se 

The small portion processmg unit 16 may be an electronic oomputerfbut instS 
35 a™,,-!? r^P""^"' ?"P"*' '^^^ h^dware can beTed aSpTS w 

T^^^L^ ll^^^"^ 'P'"' Pi°?^'' ^ enlargement-reduction procSsr(iS 
a pttiphery averaging process, and (iv) a small portion extracting process aU oi 
which will be desCTibed in detail hereinafter, but it will be^SfodXfthe pre 
s«it invention is not limited to the above fom mediods. M K SfS a loC 

40 SeTrl^sST "^^^ '^^^^ *° » out^?SS,:i H 

In extracting die small portion of a multi-dimensional pattern, tiiere mav be ^ 
used a simultaneous, paraUel processing method or a sequential! seriTprSin^ 
method. The former has die advantage that the processing^tii is vS f as^ iS Sf 

SSe if a*h?.h*^.°"?J'' '°°'P°'^^°^ P^^ « cLiderablyTcS ej^thu 
resulting m a high cost. The processmg time by die sequential or serial nrocUin^ 45 

S?of roS/^f^o*" °' " par^d Fo«ss"?LXr£^^ 

can be of die order of 10 ms per picture or frame so tiiat there need anse no s^lom 

l^Z^^i'T^::^S'^:r'''^^ ^ accompHshS-^r^a^S^tSSnS 

The devices shown in Figure 1 wiU be described in more detail hereinafter. 50 

Quantizing unit (AD Converter) 

^^Snal from die TV camera is zero-clamped bv a DC 
regcneratmg circmt (tiie black level being set to 0 V) and tiio^^cSed iJto the 
bmaiy signals by die fixed or die floating^tiireshold m«hod. 

iJ • fi^^a *«shold method is the simpler. In it, the optical imaee of the nart K 

T ^^'^ signSls byTSa^iTg 

photo-electric converter m die TV camera, and dien converted into thVbLafv 

' predetermined ti^eshold l^vel. The tineshoVrie^ may be foi ef-' 
fift ZFX-^ «ttermediate level between the white and black levds Jf the La 
t'£t^JL^^'^'^^ ^ bad spot or defea which is l4e in slzTS 

be detected whereas an extremely small bad spot cannot be sensed due to flie^S 
resolmion power of die photo-electric converter used to ine Umitea 

nr Z'^^i li""^^ Pt"^?" P^ to be inspected which includes bad spots 
or defects. If the part to be inspected is an IC mig. the dark area «pr^ 
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example chrominum deposited upon a transparent glass plate. Bad spots in the dark 
area are indicated at 18 and 19, and in the bright area at 20 and 21. The video sig- 
nal 23 is derived along the scanning line 22 passing dirough these bad spots, the 
voltage/time trace of the signal being shown below the part pattern. The spots appear 
in the video signal at 18', 19', 20' and 21' respectively. A threshold level 24 is fixed 
at a midpoint between the white and black levels. When die spots 19 and 21 are too 
small compared with the diameter of the electron beam, the levels of the signals 19 
and 21' do not reach the threshold level 24. Therefore the binary signals 25 as shown 
in Figure 3 are produced and it is seen that the spot 19 and 21 in Figure 2 are not 
detected at all. 

In the floating threshold method, the threshold level is varied depending upon 
the dark and bright levels of an image so that the bad spots 19 and 20 which are 
extremely small in size may be detected. For example as shown m Figure 2, a 
threshold level 26 is lowered when the level of the video signal level is low, but is 
raised when the latter is high. The centre or mean level of the floating threshold 
level 26 coincides with the fixed threshold level 24 and is slightly smaller than the 
level of the video signal 23. The signal representing a bad spot goes to the opposite 
direction of polarity to that of the signal representing the background provided the 
floating threshold level is varied sufliciently slowly with respea to the reversal m 
polarity of the video signal 23. Thus the. binary signals 27 as shown in Figure 4 
may be derived. It is seen that the video output signal is very fast to respond the 
reversal in brighmess of the image at the bad spots and the boundary between the 
dark and bright areas. It is preferable that the level of the floating threshold 26 is 
as high as possible so far as it will not reach the noise levels in bodi the bright and 
dark levels. The floating threshold level is formed from the video signal- If the res- 
ponse time is -too long, the signal representing a bad spot will not coincide, with the 
actual spot, but if the response time is too short die resolution power is ireduccd. 
Therefore there must be a compromise between the response rate and the resolution 
power depending upon the image and hence a part to be inspected. 

Figure 5 is a block diagram of an inspection equipment similar to that shown 
in Figure 1 and provided with the floating threshold type binary converter as described. 
The object 11 such as a printed circuit or an IC mask is scanned by the TV camera 
12. A stationary threshold generator 28 gives a fixed threshold level depending upon 
the bright and dark levels of an image. A subtracter 29 subtracts the output signal of 
the generator 28. from the output signal of the TV camera 12 so that the centre 
level of the threshold level may be maintained almost at 0. The output 35 of the 
subtraaor 29 enters a circuit 30 whose gain is slightly smaller than unity and which 
slowly trails the input signal. In practice the circuit 29 and 30 are operational ampli- 
fiers one of which is a linear delay line having a resistor and a capacitor inserted in 
the feedback loop and the other of which is an inverter with a gain less than unity 
for inverting the polarity. An adder 31 is adapted to add the output signal 36 from 
the circuit 30 to the output signal from the stationary threshold generator 28 so that 
the average level of the signal 36 may coincide with that of the video signal 33. The 
output Signal 37 of the adder 31 is the floating threshold level 26 (Figure 2). A 
comparator 32 compares this signal with that from the TV camera 12 and gives "1" 
or "0" depending upon the difference tiierebetvvecn. Thus, the output signal 38 of 
the comparator 32 corresponds to the signal 27 shown in Figure 4, that is the binary 
signal. 

In the fixed threshold level generator 28 a constant voltage from a constant volt- 
age source may be divided by a variable resistor, and the other circuits 29, 30, 31 
and 32 may comprise simple operational amplifiers. 

In this description the photo-electric converter 12 has been referred to as a TV 
camera for scanning the part 11 to be inspected so that the video signals are sequen- 
tially derived but ±e floating threshold level system may be also applied to a sys- 
tem in which a two-dimensional information is simultaneously processed by using 
a photo-electric converter 12 of the type capable of storing the focussed image such 
as an array of photo-electric cells and a memory of the type capable of storing an 
image which has uniform brightness over the whole area thereof and whose centre 
level, that is the spatial average, is fixed. The memory may be for example an array 
type frame memory. Instead of the subtraaor 29, for example an array type opera- 
tional amplifier group may be used for shifting the brightness of an image by sub- 
tracting the average brighmess thereof. The circuit 30 is a filtering device such as a 
low-pass filter. The device 31 is an image adder and the device 32 is an image com- 
parator, ITierefore the output 37 of the image adder 31 becomes the two-dimensional 
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oflT^tl^&'Zlt'^S^^^^ ^ i-ge portion in excess 

very taTelelriS ^S'STthf Ir'^'^^"^^^^^ ^^-^ 
5 but in the floating irSSd'sytSi described th?rh T ,1?'^- ^ P~W«»> 

to the slow driftio tlS^tTe pSm of S nn??"^'* ^'I'^ ^ J^"'' ^ '^'P^ 
verted into the binary siRnafsThSefoi^,^ ^T^"" ^'SP^ con- 

a bad spot may be eldSTetected ^ * """^ ""^^ P''"'^ ^^^'^ "Presents 

10 reco^dordetlT^Lt"^^^^^^ to a pauem 

problem. That is. when the thSlf fcvel 24 isSfjn nrJ^ 1 ^.'^^ * 

20 Two-Dimension Buffer Memory 

as th™pt?cal t^'etiforjSc? iS^iZT^^^. 

« andjen rearr^^ m tune by 

video tapulSiS sTS'a^Sln'^''^*^^ 25 

tion processing of this tvne has bee^ J^r^rt,, I ^u^!* Conventional infoima- 
A trSnendous^amort STvideo SSo?^^ ^^^^^''^^ ^^"^ ««°P«er. 
and is processed in order TdeS™fiLSf4i nf\h^^^^^ ^ 
when a picture frame is divided bv 240 h„^c .the object For example 30 

320 lines in the lateral dS^rinn Vit * ^ longitudinal direction and by 
bits are used to S^ent Ae bri^^-n"? ^T''*- ^^'^^ ^''^^ ^^^°^»ts. If g 
memory capable of £SS 461 ka% L'S^/p'"?^ » large-capacity 

must be processed. If S t3S Itw JSrr^^^r!. ' ^"^*e"n«>« each picture el^ent 
it would 4e abom 7 7 ^c^ to prlSssTJf Se T"^' P^««« elemenii 
stored in the memory is large^i?the d4SLE,?^^^^^ 
capacity electronic computer S^Tbe Sed^for a^^Se ' 
inspecaon equipment becomes very high. "naaeraWe tmie. Thus the cost of the 

and L'^^SSsi^d^^S JaS'lniZS'ntv'h^Jet^-"^ ^ ^ ^'^^^ 
soon as It is received. i^ieTrad^Se Sltl"^^^^^ 
be proc^sed at a speed equal to the input sp?S ^ aformauon may 

taneoudyl^^g^ rftl^So^Zrin"^, '-T "^^^^^ .^^'^ « "P'^le of simul- 
are derived for el^pfe ^ ^^Tf ekS^'Sil™^^^^^ "^^'^ 45 
dmiension buffer meinory sho™ie tte twS?m<^? ^ ^" the two- 

by using 1 limt filter. However Aisi; T^T^ ^ scaiming 
p«n=nK orthogonal ,„ .£ Sitto a^^^S^','^..'" 1"' 

SoKj r ttS/Si^ tenT&. Se°* 
=,.pn.en, ^ ^^7^^,^^^^^' 
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if only the inforaiation encircled by the area 39 in Figure 6 is stored and processed 
the number of storage elements may be reduced. Furthermore the mfonnation is 
niocessed as soon as the video infonnation obtained by scannmg is received so that 
ht processing time may be considerably reduced. Thus the device may be con- 
structed quite simply and may process the two-dimensional informattm at a lugB 

"^Thus, when the encircled information aiea 39 has m scanning lines each having 
a length /, the information corresponding to mXl is to be processed. If the "ix/ 
portion is capable of acting as a store, the storage capacity is such that only the 
hiformaiion on (w-l) scanning lines need be stored, not on m scanning lines. Ihe 
equipment would be very complex in construction and expensive if the storage ele- 
ments used for storing the information along the scanning line / is such that the 
continuously changing brightness information may be stored. Therefore a practical 
method is to divide the scanning line at a suitable interval depending upon the spac- 
ing bet\veen die adjacent scanning lines (in practice the scanning Ime / being samp ed 
iu time) and to quantize the sampled information for storage. If the scanning hne / is 
divided into n segments and a number of k bits is used for quantization, the storage 
capacity for storlig the information 39 will become mXriXk bits. The quantized 
^formation may be stored by reg-iiters, delay lines or shift circuits usmg bubble 

*"^-RCTre 7 shows one embodiment in which »i=3, n=4 and k~2. The image 
input device such as a vidicon 12 is used in order to convert die optical unage mto 
the electric signals. A control signal generator 40 generates the sync signals and scan- 
nine signals to the image input unit 12 and to the samphng umt 13. In icsponse 
to tfie" scanning signal the video input unit 12 scans horizontally scanning m a manner 
well known in the art so that the two-dimensional dark and bright image may be 
converted into the one-dimensional electric information representing dark and bright 

The dectric information is sampled by the sampling circuit 13 in response to 
the control signal which is appUed from the conttol signal generator 40 made ^ 
^chronism Sthe scamiing signal. Therefore the scamimg »>n«i»%{i^»^J^! 
» segments. A quantization circuit such as AD converter 14 converts the analogue 
eleS information into digital infonnation in response to the sync agnd apph«^ 
ftomtije control signal generator 40 in synchronism witii the amphng penod. Digital 
informatimi derived from the quantization dxcuit consisB of k bits. 

Sh^ registers 41 and 41' are adapted to store the quantized information on 
each scanninTHne and shift their contents toward the output m response to the ^c 
signal applied from the control signal generator 40 in synchronism with da samphng 
frequency. Each shift register comprises nXk bit memory dements, and the output 
signal consisting of k bits is appUed to the register 41 to the register 41 . 

% shift register 42 consisting of mXnXk bit memory dements stmes the 
encircled information 39, and any bit may be written into and read out from the shift 
register 42. The output of the quantization unit 14 is apphed to the input terminal 
fft teraiinak) of die lowermost stage of the shift register 42, die output of the shift 
register 41 to the input terminals of die middle stage, and die ouqiut of die shift 
reaster 41' to die input terminals of the uppermost stage. AH of die above outputs 
ail appUed m response to die sync signal from die conttd signal generator 40 in 
synduconism widi die sampling frequency. Furdiermore in lepnse to die sync signal 
the *-bit signal m each stage is shifted to die right. The bit information stored in 
die shift register 42 is applied to die processing circuit 16 for processing the bit 
information. The output of die processing circuit 16 may be apphed to anodier devire 
or may be written into die shift register 42. The informauon processing by die circuit 
16 Is abo effected in refuse to die sync signal qipUed ftom die contrd signal 

The hnage is scanned from left to right as in die case of the scanning used in 
die television so that when tlie right bottom comer of the <mcircl«i informatm area 
39 is scanned, all of die information area 39 is stored m die shift register 42. Ihe 
circuit 16 processing die information stored in the shift register 42 is coupled to 
odier circuit die nature of which depend upon die objects of the data processing, 
but diese are not within the scope of d:e present invention and no ftirtiier description 

As the scanmng and sampling operations proceed, the contents in the shift 
reri-ters 41, 41' and 42 are shifted. That is the information corresponding to one 
shift is stored in the shift register 42, and the output entirely different from the 
above information is derived from die processing circuit 16. As the miage is scanned, 
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XM^r^J SrSl? I'l^.^^^'^' 1« «> that whea the 

5 41' ^Cb^HS^rSavIS t r^i,°^ the shift «Bis«rs 41 and 

to store the SiaLSTsiSirSd faSeaS ^ « onkr 5 

circuits 44, 44' Sd 44^S^ St^S^ ^^^"8 J' ^ figure 7 sampling ^ 
from the 'control sigll gSSaS 4^? nmSri'^u*' 'J^*^ ^PP«^ 
quantization circuit 14 shSwTFil,™.^ T^'*^' Furthermore instead of the 

10 45" which are ako a<5u^S™ resSf^m tS^ quanti:^on circuits 45, 45' and 

dpal generator 40 aS^?^ided m m?d^ofTr^ ^""^ ^ 10 

diat described with lefeiW toFiiS^Tt It^^l^TV ^^^^7 simflar to 
here. " 7, so thtt no further description is required 

15 infoxS l^"}'^,tt:^'^r^l 7 for storing 

duft „gi«ers 41 J {l^clnSedX pt^t SlS-'i^ jr ^5 
turn are contro ed by the sync simals aonliS frn™ a "fPectiydy, which in 
in synchronism with V Si^rSnS^^fa SToSL^S^T'* ^0 
assumed that ;=3 and infonnatim on^t fi?« P^"*"?- «°*«'<l«oent it may be 
rtigister 42. In response to S?s?ij; ^A^fJf°^l Ime is stwed in die shift 
the control signal genSat^'H^late^d^e' ^ZT^ ^ 20 
the output of the circuit 14 to tiiedu? r • ^ *5 ^ate for applying 
applymg die output ^Stht L^"^ ^ ^ate to 

and similar the rate for applvinrS^r^,tr™,f of ^K^uV*™^ ^"^^ is closed 
temiinal of the ^ Ksi£ 2vw^Lny^i °^ ibe slah register 41 to the input 

of die shift re^S'4"^rtht'inpu?S,:fSon^^^ ?Sf^^S 25 
in response to the scamung of the second^ S^- ^ o*er hand, 

the gates 46 and 46'loftlt difLSZ .third lines, an off signal is applied to 

put signal of the circuit 14 if araliSl m t£ dfffr • ^f!"""*^ out- 

'Pe .iertce 16 be skipped JTin fS,S 1, andff iidi^.^,'.9°^ « 
Bgiial applied to the ptocessine devia is hifT.!- • " ™ 

diffet^t ^ „f Mt^S.i.S^^SVtl^SS/S^Sld'^'!™ 
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Small Portion Extracting Device 
1. Boundarj' Space Method: 
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projection or recess at the boundary so dial only the bad spots may be extracitd 

'^NSt^eferrin? to Figure 14 the principle of the method for extracting the 
micro spoB which may be the bad spots or projections or recesses at the boundary 
5 will be described. The method for extracting a micro-spot off the boundary is 

to extract the picture elements whose brighmess changes from bnght, dark and 
bright or dark, bright and daric in one direction of the picture clenients. For ex- 
ample the bad spoB 50' and 51' may be detected because the brightness changes 
frZ bright, dark and bright and dark, bright and dark along tlie horfom^l l'n« 
10 54 and 55 respecnvelv. However there is the possibihty that a horizontally elongat^ 
nJi^sfit or bad spot may not be detected so that ir shouW be monitored in Ae 
vertical direction and if required in an oblique direction. Therefore any bad spot 
may be detected with a required degree of accuracy in practice. 

As for the extraction of the projections or recesses at the boundaries, two 
15 micro-regions are selected in such a manner that each picture element may be 
interpos^ therebetween. If one of the micro-regions is dark or bnght when the 
other micro-region is bright or dark, then the projecuons or xccwses at the bound- 
Tes may be identified. For example the projection 52 at the boundaj is mter- 
posed beween two micro-regions 56 and 56', and the 90 
whereas the micro-region 56' is dark so that the projection 52 nwy be identified. 20 
Similariv the recess 53 is interposed betv/een two micro-regions 57 and 57 , ana 
the fonier is daric whereas the latter is bright. When the micro-spots extracted 'n 
the manners described above are compared with each other, the bad spots 50 and 
51" may be distinguished from the projecdon and recess at the boundaries as 

25 shown ^^^[J^^;^,^^ ^^^^^ boundary space mediod will be explained 

with reference to Figure 16 which illustrates in block diagram of the equipment 
shown in Figure 1 and provided witli the processing device. The optical image 
of a part 11 such as a printed circuit to be inspected is converted into electrical 
video signals by the photo-electric converter 12. A block 59 in the diagram indi- 30 
cates the binary conversion circuit 14, the sampling circuit 13, and a device 15 
for extracting the two-dimensional miao-spot video information from the con- 
tinuous video sipal 58. The equipment further comprises a oroiit 61 vxji7an.ci- 
ing the micro-spots from the pattern based upon the above described boundaiy 
• space mediod and a circuit for extracting the boundaries of the pattern. Inrtead 35 
of die device 61, a device based upon the enlargement-reduction or boundary 
averaging method to be described hereinafter may also be used. ^ . . 

The micro-spot or local video signal 60 is applied to botii the miao-spot 
extraaing circuit 61 and the boundary extracdng circuit 6?, and the output signals 
40 63 and 64 of tiie circuits 61 and 62 are applied to the comparator 65 so that ite 40 
output signal 66 mav indicate only a true bad spot This is displayed by a bad 
spot dispiav device 67 such as a monitor TV. If required not only die bad spots 
but also die background may be displavd in different colours as shown m Figure 
15 so that the position, sizes, types and the like of a bad s?ot may be more apparent. 
45 One example of the small portion extracting circuit 61 is shown in figure 45 

17. Some examples of die portions of the image consistir,% cf 5x5 picture elements 
are shown in Figure 18, and any micro-spot consisting of one or two picture ele- 
ments is to be detected and extracted. In Figure 18, ref°.r;nce numeral 75 designates 
a logic pattern for detecting and extucmz a u-Jcro-spo': m the vancal direction, 
50 76 and 77, tiiose used in rfie horizontal di>-ctionj and }% 79 ai.d 80 and 81, those 
used in the diagonal directions. . , . i. u i • . 

The circuit 61 is shown in Figure 17 in conjunction with the logic patterns 
74 and 75, and the output 70fl becomes "1" when ihere is a .nicro-spot consisting 
of one or two picture elements in the vertical direction. SSoi, .58t>, 68c and bSd are 
55 AND circuits, and tiie inverted inputs are applied to die mput ttrmmals with the 55 
symbol o. 69 is an OR circuit The circuit s-hown in Figure 1/ is so arranged that 
its output 70a is "1" when the centre picture element 71 jS "1 and both the 
picture elements 72 and 73 are "0" or when the centre picture element 71 is 0 
and both the picture elements 72 and 73 are "1". Similarly from die logic circuits 
arranged for tiie logic patterns 76 to 81 shown in Figure 13 are derived die out- W 
puts 706, 70c and 70d which are aU "1". Consequently, when die picture element 
71 is one of two adjacent picture elements or a single picture clement, the OK 
circuit 63 gives the output "1". . ^ ^ 

One example of tiie circuit 62 for extract-ng the boundanes oi the pattern is 
iUustrated in Figure 19 and the logic patterns to be handled by die circmt 61 indud- 65 



50 



65 



1,417,721 



tavmg JO dctcc in 4e diagonal, «rt=d Sd LS-f dSi^reSSv 

2. Enlargement-Reduction Method: 

For the sake of explanation it is acsumed that the part 11 to he in<!npr-^' au- 

*en.ducedaS?r*^^^^^^ 

of the enlargement and reductioT meSdTth^ ^^S^V'^or '^^^'^V'T' 
.^^gmal conhguration and position but the IS o" "1" tST<£ 

minu?S?ecris' pS'^^^^^ P^"^ deluding a very 

various purposes. The image of « nrin«^ o's. "stored pattern may be used for 




• I J a smau area 

mcludes a small area "1" indicated by 97 



™ ** -j^""" '^^^^ 1 inojcatea by 97. 

by the same distance toward the juS «1" fr^ rtJo ..n.?^ boundary is reduced 
is obtained. It is seen that die ^^f aJ o?° ^ T ^ Pattern 91 

is restored. In 4er wS, ^^^^^^^ i^^ori^.l area 89 

^.s shown in the pattern 91 ^ ""^'"'^ " ^ « eliminated 

patteS^92VISV?icL\S^^^ 'T't?thfnS^r^^' ^"^ ^ 
Aat Ae defea or area «0" 89 S £ on?J pj corresponding to 
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„ .^T sat S*a. b=i„g reduced 

L'S.SgS means the .tea "0» f^^S^rSS; metW be dc- 

to b Utarated at 99, 100. S„f^i?^JlS^„S sto 1 illumied at 103. 
""'"S of the patter, 98 ate e,*r^ in *« ^"i?™?;,'!!;?'™ » 

'^i^X^Z^^r LS SS.^t|"™a m«ns,hat tte large and 




35 i "0". WheJ the Pi5™«. JeMs SdXm "r o "0" i that the 

4C. it is seen that wnen the pioure elementor demote 1, a« rea ^^^3 ^3 

TthtSe^Stf^SS^'T^ in tflpattem 94 disappears 

''^ %.^''^lirSS^"'S^d for eliminaung a tnicro-spot by the enlarge- 

graphic method does not f°"^.^"y J^" "!i-7^ photographic 
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S-S^Tbe%S^r°-^^ ^ -thod for 

5 the expanded or Mla?S darV I'rLf^^ The pattern 109 includes 

tained^an^^tT^^S^oI^?^^^^^^^ ^ 110 » ob- 

which the da'rk area S the oS^ino ;! P"^"^" "P' « P^«^™ "1 is obtained in 
10 image 111 is aiStSuy siSfJo 4e on^'^'f* or reduced. The pattern or 

micro-spot included S Tk" S S rb^^&^'^Zl'lor^^l'^' '"^^^ 1° 
an oSra,?4^T^£*°S-^^^^ of 

the Sated ly\'Sy Sefwr f ^^^^^^^^^ "1' 

ov«Iaid upon and regifSeHith the pr^L^^^^^ ^ on?v^ral'^ ^ 

is obtained in ^llSSi ' pattern m 

of the pattern 114 a nattern iiV^^ u v ^™«ed. By the reversal processine 
25 original^hnaS^iJjl; re& cimpreLd' " ^^'^ ^"'^ » 

By the reversal processing of the fihn 115 a nfltt-m 114 • u • . 25 
the expansion reversal processL of dieTattin' i^^ is obtained, and by 

which the dark area in the pattlr^ 115 W e^H ' * P^"^". « ''^^^ ^ 
114 is substantially similar ^£ 031^114'^ ! ^ ^""^ Pattern 

of the original 107 the patSn linTbt^.^ed h^^ P^^^^'^'S 
cessing of the pattern 114, thTmttei^ 1?? .^ „w J^v*''^.*''?^'''''" pro- 
one-to-one correspondence beSrSx S iSZ^^"'' "^"^ ectablish the 
the pattens 114''and 115 'TS^^^aS'JesS " '^'^'"^ ^'^^^ 25, 

and ^"e^ttr m^'sutoSl^^^^^ ST'^ ."^ f -P-'I^l or enlarged, 
micro-sp« 117 is eliminated ^ ""^^ except that the dark 

enlarging or expanding tTSk aS ?c L •"f"""^ °i ^^P'^ssing and then 
4C or expanding aSd then^ ^Sg rco£SbgTe"bSht"rS '''^ "'"^^"^ 

• spot l^y'SanS/^de^^SW^^^^ ^-11^. the dark micro- ' 
to each other! only £ miSSS" wZtmtTr T 

extracted. Alternatively when ArjaueLflT^^/i'J'^^^ " ^ easily 

all of the miao-spots 117 and 118 SSed in th^'* "-^ T '^S'''^^''^'' ^o each otiier, 
detected and extracted. ""^mal pattern 107 may be readily 4f 

proc^^T/th'etS^tl? fnd\rS ^ ^^^^^.^^ »P^^io= reversal 
112, a pattern 11? S^t^ed to whi^ aSTt^^^^^ °^ P^«ern 

50 in the original 107 are ifis lei v. "^"^ "^f in^^ded 

area^? -^S^fe^eitrfedtd^^^^^^^^^^ '^"l^ 
the process in which the br4 °t aS^ff^. JJ^^ again (which is equivalent to 
53 redu^d again), and miSo-snot, nS.M ^ ^n'^ged and 

By tlie compikso^of thT^lTi^^^ °"S"^1 10^ are aU eliiSinated. 
figuration of a mL^s^lt s^t 1^ ^f^^ ^^h"^'' P°^'^°» con- 

before when the origS 107 i^r^ffi^^SK'^''^ '•'^'''^ribed herein- 

spot 118 in the dariria miv te^ S ^'^ P^'^? *e bright micro- 
108 is registered wiS tfTnaSn IK ^^'^ pattern 
detected Sid^S ^ '^'^ *P°* » Ae bright area 4y be 

en4;/r?paT; bj" ^ s^'e l.SS'^ ? ^°-'^^»«o^al binary pattern is 
„ amoJit or li;^t xedie? byTpSS^iied'^^^^ '^"^ "^"i'l 
« *e s.^e amo.., any mi^o-spriSSStTMS S'e£aS'f^,£ 
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comoarison of an original pattern with the pattern pro.-e-„scd by one or both of the 
S Sods Tny micro-spot included in the original pattern may be extracted. 
''^^ V™i tSJ defects I noise components included in a pattern arc very minute 
S3 that thev may be readily extracted by the processes described above. 

5 T^^cWroo^d^^not 

fS poSrKr; SSeileV^^hich has b- P.^^^^^ 

t£u^ Ke a "^^^^^JS^^S^^^ 
10 S -i-Se detail with% reference pattern: this ^vdd Mojv from t^e ^^c^ 
rh« t-hp. nart to be inspected would have various defects. Therefore the processes acs 
Sbef aS relS in their application to the inspection of pnnted c^cmB, 

pSen^ore anyTew p^attL which has been hitherto never processed may be equally 



12 



10 



15 



20 



In the Drocess-s described above, the amount of enlargement or reducuon deter- 
mines the sK a mSo spot or defect to be detected. Therefore the parameters 
2° SeTfo? the p^ose of detecting a relatively large micro-spot or defect m a lar^e 
StKrn shoold^t be used for detecting a relatively small m»cro-spot or defect m 
fsS pattern Such inspection conditions would generally be laid down m detail 

o« *NiSL?^'R^^^ a large number of storage elements are arrayed 25 

^ PS sh^Jf at l^aSd 120 fn opposed relation with the space of an hnage Any sion|e 
SeSTWy be used as far as information may be written into and read out from ii^ 
S^rS tWs embodment flip-flops are used. In the arrays 119 and ^f^^^^ 
dSnid by tiie broken lines represents a picture element m opposed relation widi 

correSondfns pSure element being bright or dark. For '^^^^^^^'^^.^^'fiZ 
out device 12 is a television camera of the type scannmg an object horizontally from 
Se uDoer left to the lower right, the output signals from *e quantizing circmt 14 
3. $ sf^Sii?5y storld in the lip-flops in 'the array 119 from die upper lef t one to 35 
Uie lower right one. The above arrangement is well known m the art so that the further 

serves to S>We infomiation to be processed in a manner now to be described. As 
40 fn Figure 26, each flip-flop in the arrays 119 and 120 IS idenufied by the 40 

coordmatg (r, 121 serves for the enlargement process described hereinbefore, The 

conteiS Yn ^e five flip-flops (i-l,/)> {i^M)> (^^+^) ^^I'^h^l I Z 
»r«,v 11Q are anolied to the OR gate 121. The output of the flip-flop {t,j) m the 
45 S 120 ralso'S^Sed'to'L Olfgate 121 Similarly, such an OR gate is provided 45 

for every i and ;. (For example when 2, , m and ;-l, 2, . . . .. n, we 

oml of »/x« OR gates are provided. The number of inputs to *e OR gate is less 
S five when i and ; approach / or m or n). Therefore the enlarged «1" is applied 
to the flip-flop array 120 from the flip-flop array 119. .u. fl:^fl«„ 

50 For exaiJple when information is stored as shown in Figure 27 m the Aip-flop 50 

^ array 119 (the^ hatched square represents, the flip-flop J 1 tn arrav IM » 
sfluare the flio-flop state "0"), information is stored m the flip-flop array izu as 
K?a?123 in KgS 27. This means that the hatched areas are enlarged or ex- 

55. ^^Thz method for storing in the flip-flop array 120 the reduced area infomiation 55 
® of die ffip-flop array 119 my be accomplished by using AND g^tf "n^^j"! ^ *J 
OR gates 121 sho^ in, Figure 27. That is, the '^f°^H°\l'°''iZn J^\^ 
array 119 as shown at 123 in Figure 27 may be stored in the flip-flop «ray 120 
as sLvn at 124 in Figure 27. This means that the hatched areas shown at 123 m 

At Fieure 27 are reduced as shown at 124. , 

^ ^The hatched areas shown at 122 are enlarged as shown at 123 and are nduced 

as sho«^ at 124. It is seen diat the small white area included in the main hatched 
area shown at 122 disappears in the pattern shown at 123, as is required. 

The process is made in two steps in the manner described above .so that the 
65 equipment may comprise in practice, firstly, means for storing die video information, 45 
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secondly, a plurality of OR gate means each of which is coupled to a plurality of 
predetemuned storage elements in said video information storage means thereby 
givmg the OR output of the outputs of said predetermined storage elements, thirdly, 
storage mrans for storing the outputs of said plurality of OR gate means, fourthly, a 

5 plurality of AND gate means each of which is coupled to a plurality of predetermined a 

storage dements m said OR gate output storage means thereby giving the AND out- 
put of the outputs of said predetermined storage elements, and fifthly, storage means 
for ^nng AND outputs of said plurality of AND gate means. The states of 

in u ™ '"^^ illustrated at 123 and 124 in Figure 27. 

«rpcc^ f^""^ fourth means are exchanged, the hatched areas are com- m 

pressed first and then enlarged. The state of the fifth means is illustrated at 126 in ^ 
Fi^re 27 m which the smaU area "1" included in the laige area "0" is eliminated. 
Stat<s of the first and third means are illustrated at 122 125 respectively. 

H ^u^^ the arrangements in which the infonnation or area is first compressed 

15 and enlarged or fiwt enlarged and reduced, the number o'! mXn EXCLUSIVE OR i<c 
pites may be provided m such a manner that the outputs oi the corresponding storage 
elonente m the first and fifth means may be appHed to each of the EXCLUSIVE OR 
gates. Then Ae output "1' of the EXCLUSIVE OR gate means ttolhe sa^ of 

oii '^°'^Be elonente in the first and fifth storage means are different. 

X:.X .SaT''' » ^ that i, a bad spot 20 

k,„ !2 "i .^Sram form an embodiment of the present invention 
"^^^ Jl'^^P^'^ °f enlargement-reduction method. S 

05 5S ^f^JT^^ ^ ^'^^ conversion circuit 14 are stored in a storage 

127 which IS similar m construction and operation to the flip-flop array 119 or 
hvT n/'^" M"™?^^'? *e storage device 127 is p^S ^ 

nf Pf? "f"^*??, 28^.which is similar in const^ction and operation S a 
plurahty of OR gates 121 m Figure 26, to be applied to a storage devi« 129, -nich 
IS smular m construcucm and operation to the flij-flop array 120 in Figui 26 S 

30 mformation stored m the storage device 129 is processed by an AND gat- network 

.construction and operation to a plura% of AND gates descSa h-S- " 
tefore to be aw^h^ to a storage device 131 sinilar to the flip-flop ma^ 120 in 
Figure 26. An pCLUSIVE OR gate network 132 functions in tL mUS desSbS 

3- ^"^K** ""''"'T ?^ °"'P"' °"tputs of the correspondingly 

3.. elements m the storage devices 127 and 131. Networks 128', 129M30', 131' S v 
132 are sunilar in construction and operation to those 130, 129, 128. 131 and 132 
respectively. An OR gate network 133 is provided to give the OR output fS S ' 
outputs of the corresponding storage elements in the borage devices 132 and 13? 
The output of the OR ate network 133 is stored in a storage device 134 
A neiembefore the storage elements which are "1" in the storase in 

i^^. ^? "',5' «ilargement or expansion of the storagrdemenS "I" TZ 
storage device 127. The storage elements which are "1» in the storaj devire 131 
are the reduction of the storage elements which are "1" in the 

,5 S'^r^'S* 1^'^ ?" i° the storage device 129' are tte Son of 
45 the storaee elements mhirh arA «i>» ;„ r j • _ -^^ ^ ivuuwwuu ui 




•15 



The small area" «1" mduded m the large "area" «0" in the storage device 127 is 

W.T.'^n!". ^ 'T^^ ^""^ ^ly- ^^'"^ ^^'^^'^-^ OR oS^uts ^ derived 
from the outputs of the corresponding storage elements in the storage devic^ 127 
and 131, only the smaU area «0" induded in the large area «1» in the^toSevic; 

':i». Smiilarly the smallW «1» indudeThKgl 
5-^ nl n,rt^J A ^^Tc ^^""^ as the "area" "1" when die exclusive 

OR omputs are derived from the contents in the storage devices 127 and 131'. When 
he OR ou9>uls are derived from tl.e outputs of the corresponding storage e emSS 

are stored as "Is" m the storage device 134. ^ 

<;/^ n^'^^ networks 127— 134 and 128'— 132' are iUustrated in detail in Figure 29A 

?±rJn"»,?'^f ? f"' °^ '^P^'^y' ^ the similwS? com: 

ponenB can be sucked perpendicular to the plane of the drawing in practice Se 
mpur terminals of the AND rtes, OR gat<^ and Exclusive OR gatS Sh^ 

65 Eadj square of the storage devices 127, 129, 131, 129'. 131' and 134 represents 65 
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a storage dement for each picture element and stores "1" or "0" depending upon 
Whether the corresponding picture element is bright or dark. Reference nummls 
128, 130' and 133 designate the OR gate networks; 130 and 128', the AND gate net- 
worksi and 132 and 132', the EXCLUSIVE OR gate networks. Each EXCLUSIVE 

5 OR gate may be provided from two AND (NAND) gates 136 and 136' and an OR 5 

gate 137 connected as shown in Figure 29B. 

In the embodiment described here the centre picture element as well as four 
adjacent picture elements are processed, but it will be understood that the number 
of picture elements to be processed is not limited to five. When a bad spot or micro- 

10 spot to be processed is larger than a picture element, the number of picture elements 10 

to be processed must be increased accordingly. Furthermore in order to overcome 
the problem of directions of the enlargement and reduction, it is preferable to handle 
all of the picture elements included in a circle whose centre coincides with the centre 
picture element When a panern except a bad spot consists of a horizontally or vcrtic- 

15 ally extendmg areas, it is preferable to handle or process a cross-shaped picmre 15 

element as a centre element, that is a centre picture element extended in the vertical 
and horizontal directions. 

In some cases it is more efficient to process the picture elements in step than to 
process all of the picture elements simultaneously. For example, instead of enlarging 

20 in both the vertical and horizontal directions by one picture element in the manner 20 

described with reference to Figure 26, the cenure picture element may be enlarged only 
in the vertical or horizontal direction by one picture element In this case, the similar 
result may be attained. The process described with reference to Figure 23 is this 
method. When the process is accomplished in step, the processing time is increased, but 

25 the processing equipment becomes simple in construcuon. 25 

Next referring to Figure 30, an equipment for accomplishing the optical proces- 
sing methods described hereinbefore with reference to Figures 24 and 25 will be 
described. It will again be appreciated that the following description with reference 
to Fig. 30 and Figs. 24 and 25 does not form any part of the invention claimed and 

30 is only included to assist in the understanding thereof. In practice a condenser lens 30 

(not shown) is interposed between a light source 138 and an original film 139 in 
order to provide the uniform illumination. An unexposed film 140 is placed upon a 
frame 143. The original fikn 139 corresponds to the original pattern 107 in Figures 
24 and 25 whereas die unexposed iihn 140 is used to obtain the pattern 108. When 

35 the pattern 108 shown in Figures 24 and 25 is used as the original fihn 139, the 35 

unexposed fihn 140 is used to obtain the pattern 108. The image on the original fihn 
139 is focussed at the same size through a projection lens 141 upon the unexposed 
fihn 140 placed on the frame 143. The original fihn 139 is placed upon a frame 
142 which in turn is slidably placed on a frame 144 which in turn is placed upon 

40 a frame 145 for slidable movement in the longitudinal direction. The positions of the 40 
light source 138, the frame 145 and the lens 141 are fixed. 

An operating lever 146 whose one end is fixed to the frame 142 has an aperture 
147 through which extends a pin (not shown) extending from the frame 145 so that 
the movement of the frame 142 by the operating lever 146 is limited by the engage- 

45 ment of the pin with the aperture 147. Furthermore the rotation of the frame 142 is 45 

prevented. 

Next the mode of operation will be described. First the light source 138 must be 
turned off and the operating lever 146 is adjusted so that the pin is located at the 
centre of the aperture. The holder 143 is adjusted so that the hnage of the origmal 

50 film 139 may be focussed through the projection lens 141 upon the unexposed film 50 

140. Next the lamp 138 is turned on and the operating lever 146 is actuated in such 
a manner that the pin is run around the edge of the aperture 147. Thereafter the 
lamp 138 is turned off and the exposed film 140 is processed. Thus the expanded and 
reversed image is obtained. When it is desired to obtain a reversal image, the operat- 

55 ing lever 146 must be mamtained stationary. 

The above exposure process must be made in the dark room. It is preferable to 
use a high contrast fihn such as a film used for preparmg a printing plate. The aper- 
ture 147 in the operating lever 146 must be determined depending upon the enlarge- 
ment or reduction amount or scale and of course upon the size of the pin. In general 

60 the aperture is curcular in order to eliminate the problem of the direction of the en- ^ 

largement or reduction, but in some cases an aperture may have a special configura- 
tion depending upon the purpose. The position of the holder 143 must be correctly 
determined because it in turn determines the distance between the original film 139 
and the unexposed fihn 140 and also the accuracy in registration between two pro- 

fiS cessed films when they are registered with each other m order to extract a micro-spot 
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in the manner described with reference to Figure 24 with the two patterns 110 and 
107. It is therefore preferable that the bolder 143 is located in a pr^etennined posi* 
tion in the equipment. 

The equipment of the type described above may be used for example for cor- 
5 recting a pattern liaving a micro-spot or bad spot A pattern which is used for manu- 5 
facture of printed circuits or the like and which has bad spots or defects caused in 
drawing the pattern may be corrected by this equipment Furthermore an original 
film used for printing a number of copies may be also conected by this equipment so 
that the original Sim may have no defect or flaw. The equipment can also be used 
10 to provide a pattern only showing the bad spots. 10 
When the printed circuits which are manufactured whfa a pattern having a sharp 
angle are inspected by the equipment of the present invention^ a portion having a 
sharp angle may be detected as a defect or bad spot However when the original 
pattern used in the inspection is corrected in the manner described above, the portion 
15 having a sharp angle may be eliminated so that diis portion may be prevented from 15 
being mismkingly extracted as a bad spot Therefore the equipment may be used 
for preparing a reference pattern best adapted for use with the micro-spot inspec- 
tion equipment in accordance with the present invention. It is of course understood 
that a reference pattern in which a sharp angle portion included in an original pat- 
20 tern will not adversely affect the result of the inspection of the parts numufactured 20 
from the original pattern. 

As described hereinbefore an area in one binary state in a two-dimensional binary 
pattern is enlarged or reduced in the two-dimensional space and tihen reduced or 
enlarged so that the micro-spots or bad spots included in the pattern may be elimin- 
25 ated. 25 
By comparing the original pattern with a pattern obtained by one or both of 
the methods described above, only the micro-spots or bad spots included in the 
original pattem may be detected and extracted. In enlargement and reduction the 
boundary line is preferably enlarged or expanded and reduced or compressed in the 
30 direction perpendicular to the boundary line, but the present invention is not limited 30 
to this method alone. 

The eliminated or extraaed micro-spot or bad spot is very closely related with 
the expansion and compression of the boundary line. The higher the degree of expan- 
sion or reduction, the larger the size of the eliminated or extracted micro-spot or bad 
35 spot becomes. 35 
Therefore when it is desired to eliminate or extract a micro-spot or bad spot 
according to the present invention, it is preferable that the pattem (which must be die 
correct pattem having no defect or flaw) is larger in size than a bad spot When 
the sizes of the original pattem and the defect are different, only the defect may be 
40 eliminated or extracted without adversely affecting the original pattem by suitably 40 
selecting the displacement of the boundary line in expansion or reduction. 

Even if the above conditions are not fully satisfied, a bad spot or defea may be 
partiy eliminated or extracted and when the same process is cycled, the bad spot or 
defect may be completely eluninated or extracted. Therefore there is no problem in 
45 practice. For example a bad spot included in a printed circuit is generally smaller 45 
in size than the conductor and non-conductor patterns. When a relatively large defect 
intersects Ae original pattem such as a conduaor pattern, the intersection generally 
has an acute angle so that a gap between the defect and the original pattem tends 
to be detected as a micro-spot or bad spot Therefore a relatively large defect may 
50 be detected from the gap between the defea and the original pattem which is detected 50 
in the manner described above. 

A relatively small spot included in an original pattem may be eliminated or 
extracted so that a complex pattem may be corrected, that is a pattem from which 
the noise components are entirely removed may be provided. Alternatively only the 
55 defects or noise included in a complex pattem may be reproduced as a pattem. 55 
For example a thin portion and an un-printed portion of a character pattem 
may be corrected so that a correct character pattem may be provided for display or 
the like. When the present invention is applied to the pattem or character recogni- 
tion system, the character recognition eflSdency may be much enhanced. Furthermore 
6f# only the defects may be extracted and displayed as a measure of correction. 60 

3. Boundary Averaging Method: 

The boundary averaging method for extracting or eliminating a micro-spot 
included in a pattem will mitially be described with reference to Figure 31. First 
a central pomt 149 in a pattem 148 is selected and the area surrounding the central 



[ 1.417,721 16 

point 149 is investigated. If ±e surrounding areas "1" or "0" are larger in number 
than the areas "0" or "1", then the central point 149 is determined to have "1" or 
"0" and a new pattern 149' which represents "1" or "0" is generated at the position 
coffesponding to the central point 149. The above operation is cycled over the whole 
5 surface of the pattern 148 so that a micro-spot included in the pattern may be ehmin- 5 
ated. In Figure 31, a two-dimensional sampled pattern or image is illustrated, but 
the boundary averaging method may be also applied to a continuous or sampled 
pattern or image. In case of the continuous image, the area "1" is compared with 
the area "0". In the method illustrated in Figure 31, 13 picture elements surrounding 
10 the central jjicture element 149 are investigated, but the number of picture elements 10 
to be investigated may be determined depending upon the size of a micro-spot to 
be detected. In case of the continuous image the thrc^iold level is determined to 
be one half of the area to be investigated. 

A device 150 is so arranged that when the number of inputs "1" or "0" from 
15 the surrounding picture elements is in excess of one half of the surrounding picture 15 
ilements investigated, the device 150 outputs the signal "1" or "0", 

Next the boundary averaging method will be described with reference to a simple 
:ne-dimensional image or pattern. Figure 32A shows a device for generating a pat- 
by the parallel processing of a one-dimensional nnage which is sampled, and 
20 figure 32B a device for generating a pattern by the sequential processing of a one- 20 
dimensional image which is sampled. Devices 150/, 150/, 150^ ... and 150/) are 
Jlustrated in detail in Figure 33. A device 150' shown in Figure 32B can also be 
•I'milar to that shown in Pigurc 33. It is assumed that a picture clement 152 is selec- 
ted to generate a pattern 152'. In this case two adjacent picture elements 151 and 
25 153 are investigated together with the picture element 152, and the outputs are 25 
applied to the input terminals 160, 161 and 162 of die device 150/. If more than 
-wo outputs are applied to the device 150/, a voltage across a resistor R. is obtained 
iuch that a gate 164 is opened and an output is produced at an output terminal 163. 
As a result the pattern "i" or "0" is generated at 152'. In the similar manner des- 
30 :ribed above, the patterns 153', 154', . . . are generated. ' 30 

In tiie device shown in Figure 3213 both die original and generated patterns are 
jiraultaneously shifted in order to generate the patterns only by one device 150'. 

The parallel and sequential or serial processing devices described above with 
reference to Figure 32 may be also applied to a n-dimensional image or pattern 
35 which is sampled, but description of diis is not necessary as the arrangement will be. 35 
apparent to those skilled in the art from the above explanation. 

Figure 34 shows a variation of the device for generating a pattern by the parallel 
processing of a one-dimensional image which is sampled. (A) and (¥) show an original 
pattern, (B) and (G), Lhe original pattern shifted to left, (C) and (H), the original 
40 pattern shifted to right, (D) and (I), a pattern formed by the addition of the original 40 
pattern and said patterns shifted to right and lef^ (E) and (J), a binar>'.coded pattern 
of the addition pattern, and (K), a pattern generated as a function of the combined 
patterns shown at (F;,, (G), and (H). It is seen that the sum of any three adjacent 
picture elements in A is same as the piaure element in (D) which corresponds in 
45 position to the central picture element of the three adjacent picture elements in (A). 45 
Figure 35 shows a diagram of a circuit for processing serially a one-dimensional 
continuous image. Reference numerals 165 and 166 denote an input and output termi- 
nal respectively, and Dj— Dn, delay lines. The output of an original pattern is applied 
to the input terminal 165 and dius to die delay lines D,— D„. When the voltage 
across a resistor becomes higher than a predetermined level, a gate 167 is opened 50 
and an output is derived from the output terminal 166 for generating a pattern. 

4. Small Portion Extracting Method 

Opposed to the boundary spacing method, the enlargement-reduction method and 

the boundary averaging metiiod described hereinbefore, the small portion or bad 
55 spot extraaing method^ does not require a boundary extiaaing circuit. Any of die 55 

micro-spot extracting circuits based upon the above three methods may be used as 

a raicro-spot processing equipment, but they tend to detect the projections and notches 

on the boundary lines as defects. Therefore these drcuits must be used in combination 

with a boundary extracting circuit of the type described hereinbefore. 
60 However the processing equipment based upon the bad spot extracting mediod 60 

to be described in detail hereinafter may attain both the functions of the micro-spot 

extracting circuit and the boundary extracting circuit. 

Referring back to Figure 13, the hatched areas represent a copper foil on a 

printed circuit or chrominum or emulsion on an IC mask. The bad spots 50 and 
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50' are included in the dark and bright areas. The projection 52 and the notch 53 

are fonned at the boundary lines due to the sampling of the pattern. 

tv,,. 1 ""T^uT ^^^"^JP^"^ the micro-spot extracting method has an advantage 

that only the bad spots 50' and 51' are extracted but the projection 52 and the 

notch 53 on the boundary lines are not detected and extracted. 

tn lio^'^^ul^^"'"^ to Figure 36, a picture element 168 is selected and regions 169a 

to 169» that surround the picture element 168 are investigated. The configuration 

and size of the surroundmg regions 169a to 169« are selected depending upon the 

complexity of an original pattern to be inspected. Preferably the surrounding region 

is ?irS^J°JL'lM't^'^f"ir -^^ "".^"^P"" ^ ^J'o^^ elongated poition 

Lf^^t^ ^Zu'^f^^ ^^^^T^ P'*=*"« and has a Icngdi less than one 

half of the width of a nornial pattern. 

. nnJS^i* the method for determining whether the picnire element 168 is a defect or 

a taTeTn- or 'S'^Se'n-!^'^'' that ^e picture element 168 is in 

n«i^o7 ^ « t ^ 0 ). The picture element 168 is deteaed as a part of a 

onflLr 7 ""^^ 1^"° °* P'**"^ included in at lea^ 

one surrounding region 169 are Po. In other words, when the logic function 
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Fr 



,m. n • 
PonfUnpM 



U 



b'-ifun pJ) 



(1) 



where Pi/— W designate the logic states of the picture elements 170<^-.170« 

included in the surrounding region 169j, 
gives "1", the picture element 168 is identifi 
fore the logic function 



identified as a part of a normal pattern. There- 



. m n 



PoufnUP ) 



(2) 



S^tiZl'^"' is a bad spot or defect. The logic function 

Go dways gives «1" when at least one of the picture elemenis included in the s^- 
S^?? 3°?, ^^I°gi= f-^ction G. gives «1» wh?n Ae ted 

nnri 4 ^u^^ ^l^ are detected, but gives «0" for the projection 52 and 
fte notch 53 on the boundary lines. Therefore from die binary 'pattem shown in 
Figure 13 IS including die bad spots the pattem shown in Figi^U may be dkSnS 

^???' in^^'^n correspoK'theL spo^ 50' 

and 51 m the patton shown m Figure 13. If the extracted bad spots and the back- 
ground are displayed m different colour on a colour display devia, the sizes, tvoes 
positions and the Kke of the bad spots may be easily detected. ^ * 

Next an equipment using this micro-spot extracting method will be described 
with reference to a block diagram shown in Figure 37. The optical 112 off^ 
JiLfi K '"'P'u'^'^ '."'^.'^ " P'"'^"* ^"^^t mask is conv^ed into an electrical 
f-n i5 5,P^°'°-^^^S?'5 converter 12 such as a television camera. The video signal 
171 from the camera 12 is convened into the binary coded signals 172 by an analolue- 
ttHdigital convatcr 14. A device 15 extracts sequentially the two-diSinsionalTcal 
^deo signal 173 fipm the binary coded and sampled video sipal 172. A 3 pS- 
ton processing device 174 is adapted to extraa a bad spot from the local video sS- 

™ t 17^ ^ ^- ^T""'- "P"' t'^^^ ^ '^P'^y^d by a bad spot displfy 
umt 176. The display umt 76 may be a colour display device for displaymg a bad 

F^"35 '^'^'^ background from die signal 172 as Xin S 

Figure 38 shows some examples of die binary coded and sampled patterns which 

Sc^S^^aCfm ? P'^^^P^^ micro VemKg miS 

ii^ -Jl^ ^ and 179 to 186 are die pirture ele- 

ment regions which are subjected to the space logic processing in accordance^Sdi 
die present invention. Since the image is smpledftiie^egionTa^ fa 
figuranon depending upon the directions. The surrounding regi(^ iTS lSe 
be so selected as to completely encircle the central picnSe dement 178 
Awn £!^.%fi7 I '^'^^ accomplishing die above logic function (1). An 
AND gate 187 gives the output 188o of «1" when all of four picture element hJ 
wllif ?i "^^u" 17^*'^v*^^<»^«»i°°al local video signal 173. sSSariy 
when and only when all of die picture elements included in die iurrouning regS 
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179 to 186 arc "1", the outputs "1" 1886—188^ are derived. If all of the picture 
elements in any of the regions 179 to 186 are "1", the output of an OR gate 189 
becomes "1", and if the central picture element 178 is "1", the output of an AND 
gate 191 becomes also "1". Then the central picture element 178 is detected as a 

5 part of a nonnal pattern so that the output 175 of a NOR gate 183 becomes "0". 5 
Similarly, when the central picture element 178 is "0" and if all of the picture ele- 
ments in any of the surrounding regions 179 to 186 are "0", the output of an AND 
gate 193 becomes "1" so that the output 175 of the NOR gate 192 becomes "0". 
When each of the surrounding regions 179 to 186 includes a picture element opposite 

10 to die central picture element 178, the latter is detected as a part of a bad spot or 10 
defect and the NOR gate 192 gives the output "1". 

As described hereinbefore according to the present invention the local video 
signals of a dark and bright pattern image are sequentially derived and a true bad 
spot included in the local video signal is detected and extracted. Therefore the pro- 

15 jections or notches on the boundary lines may be prevented from being mistakingly 15 
detected and extracted as a defect, and the bad spots on the printed circuits or IC 
pellets having the complex patterns may be easily detected and extracted. Further- 
more only the bad spots or defects may be displayed on a display device, and an 
alarm device may be actuated v/hen the number of bad spots reaches a predetermined 

20 number. Moreover in response to the signal of the alarm device, a device for con- 20 
tinuously or intermittendy feeding parts to be inspected into the micro-spot or bad 
spot inspection equipment may be temporarily stopped, and a part such as a printed 
circuit having a bad spot may be rejected automatically. 

WHAT WE CLAIM IS: — 

25 1. Apparatus for detecting and extracting pordons in a pattern including: in- 25 

put means for sequentially scanning a pattern to be inspected and converting said 
pattern into an electrical video signal; means for sampling said video signal at pre- 
determined sampUng time intervals corresponding to picture elements of said pattern 
to be inspected and converting said video signal into binary form; a two-dimension 

30 image extracting means for rearranging the one-dimensionally arranged output from 30 

said sampling and binary converting means into a twro-dimensionally arranged signal 
representing a sub area of the pattern; and processing means for extracting a signal 
from the informadon stored in said two-dimensional image extracting means^ to 
thereby extract a small portion from said pattern. 

35 2. Apparatus according to claim 1^ wherein said two-dimensional image extraa- 35 

ing means comprises: first memory means, in which one element or a plurality of 
dements connected in series, each store the pattern information per one scanning 
line obtained by said sequential scanning and for shifting said stored pattern informa- 
don in response to the shift of the scanning point of said pattern informadon which 

40 is made in response to a sync signal in synchronism with a scanning signal, and 40 
second memory means for storing the input informadon applied to the first element 
in said first memory means and the outputs of all said elements in said first memory 
means and for shifting said stored information in response to said sync signal 

3* Apparatus according to claim 1 or 2, wherein sai4 means for converting said 

45 video signd into a binary coded video signal comprises: means for subtracting from 45 
said video signal a predetermined signal level; means for reducing the amplitude of 
the output from said subtracting means and for smoothing the reduced output; means, 
for adding said predetermined signal level to the output of said reducing and smooth- 
ing means; and means for converting said video signal into a binary coded video 

50 signal with the output of said adder means as a threshold. 50 

4. Apparatus according to daim 3, wherdn said small portion processing means 
comprises: a small portion extracting circuit for providing an output when the 
number of the binary coded signals representing one of the two states of a plurality 
of picture elements jnduded in any of a plurality of continuous patterns passing 

55 through a predetermined picture element in a plurality of directions is less than a 55 
predetermined number; a boundary portion extracting circuit for providing an out- 
put when the binary signals representing the binary states of two local areas which 
are selected in a plurali^ of directions with an insensitive region, Induding said 
predetermined picture dement being interposed between said two local areas, are 

60 different from each other; and a comparator for receiving the outputs of said small 60 
portion extracting circuit and said boundary portions extractug circuit and for generat- 
ing an output when and only when said boundary extracting circuit does not generate 
an output. 

5. Apparatus according to claim 3, wherein said small portion processing means 
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includes first processing means comprising: means for compressing and then expand- 
nrlswlT ^^^^^> ™eaM connected to saKn- 

SSIgS:? irre^L"""" "'"'"^ said binaiy'cSrf 

furtht ^'^"''l^e '0 ^1?™ 5, wherein said smaU portion processing means 

includes: second processing means for comparing an origbal pattern S 

~SSr?s'"e£nld^?r'J'^ "^'^ Processing'meaV andln STsS 
SSm. '"'^ "^^^"'"g "Id small portion included in said origiEal 

and I'rrt^^T' ^""^ ''"f t""? ^nd cxtracdng small portions in a pattern constructed 
or tig. 28 or Fig. 37 of the accompanying drawings. 

MEWBURN ELLIS & CO., 
Chartered Patent Agents, 
70/72 Chancery Lane, 
London, WC2A IAD. 
Agents for the Applicants. 
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